Facilitating access to pre-processed research evidence in public health

<p>Abstract</p> <p>Background</p> <p>Evidence-informed decision making is accepted in Canada and worldwide as necessary for the provision of effective health services. This process involves: 1) clearly articulating a practice-based issue; 2) searching for and accessing relevant evidence; 3) appraising methodological rigor and choosing the most synthesized evidence of the highest quality and relevance to the practice issue and setting that is available; and 4) extracting, interpreting, and translating knowledge, in light of the local context and resources, into practice, program and policy decisions. While the public health sector in Canada is working toward evidence-informed decision making, considerable barriers, including efficient access to synthesized resources, exist.</p> <p>Methods</p> <p>In this paper we map to a previously developed 6 level pyramid of pre-processed research evidence, relevant resources that include public health-related effectiveness evidence. The resources were identified through extensive searches of both the published and unpublished domains.</p> <p>Results</p> <p>Many resources with public health-related evidence were identified. While there were very few resources dedicated solely to public health evidence, many clinically focused resources include public health-related evidence, making tools such as the pyramid, that identify these resources, particularly helpful for public health decisions makers. A practical example illustrates the application of this model and highlights its potential to reduce the time and effort that would be required by public health decision makers to address their practice-based issues.</p> <p>Conclusions</p> <p>This paper describes an existing hierarchy of pre-processed evidence and its adaptation to the public health setting. A number of resources with public health-relevant content that are either freely accessible or requiring a subscription are identified. This will facilitate easier and faster access to pre-processed, public health-relevant evidence, with the intent of promoting evidence-informed decision making. Access to such resources addresses several barriers identified by public health decision makers to evidence-informed decision making, most importantly time, as well as lack of knowledge of resources that house public health-relevant evidence.</p

The evolution of social networks through the implementation of evidence-informed decision-making interventions: a longitudinal analysis of three public health units in Canada

BACKGROUND: We studied the evolution of information-seeking networks over a 2-year period during which an organization-wide intervention was implemented to promote evidence-informed decision-making (EIDM) in three public health units in Ontario, Canada. We tested whether engagement of staff in the intervention and their EIDM behavior were associated with being chosen as information source and how the trend of inter-divisional communications and the dominance of experts evolved over time. METHODS: Local managers at each health unit selected a group of staff to get engage in Knowledge Broker-led workshops and development of evidence summaries to address local public health problems. The staff were invited to answer three online surveys (at baseline and two annual follow-ups) including name generator questions eliciting the list of the staff they would turn to for help integrating research evidence into practice. We used stochastic actor-oriented modeling to study the evolution of networks. We tested the effect of engagement in the intervention, EIDM behavior scores, organizational divisions, and structural dynamics of social networks on the tendency of staff to select information sources, and the change in its trend between year 1 and year 2 of follow-up. RESULTS: In all the three health units, and especially in the two units with higher levels of engagement in the intervention, the network evolved towards a more centralized structure, with an increasing significance of already central staff. The staff showed greater tendencies to seek information from peers with higher EIDM behavior scores. In the public health unit that had highest engagement and stronger leadership support, the engaged staff became more central. In all public health units, the engaged staff showed an increasing tendency towards forming clusters. The staff in the three public health units showed a tendency towards limiting their connections within their divisions. CONCLUSIONS: The longitudinal analysis provided us with a means to study the microstructural changes in public health units, clues to the sustainability of the implementation. The hierarchical transformation of networks towards experts and formation of clusters among staff who were engaged in the intervention show how implementing organizational interventions to promote EIDM may affect the knowledge flow and distribution in health care communities, which may lead to unanticipated consequences. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s13012-015-0355-5) contains supplementary material, which is available to authorized users

Informing the implementation of evidence-informed decision making interventions using a social network analysis perspective; a mixed-methods study

BACKGROUND: Workforce development is an important aspect of evidence-informed decision making (EIDM) interventions. The structure of formal and informal social networks can influence, and be influenced, by the implementation of EIDM interventions. METHODS: In a mixed methods study we assessed the outcomes of a targeted training intervention to promote EIDM among the staff in three public health units in Ontario, Canada. This report focuses on the qualitative phase of the study in which key staff were interviewed about the process of engagement in the intervention, communications during the intervention, and social consequences. RESULTS: Senior managers identified staff to take part in the intervention. Engagement was a top-down process determined by the way organizational leaders promoted EIDM and the relevance of staff’s jobs to EIDM. Communication among staff participating in the workshops and ongoing progress meetings was influential in overcoming personal and normative barriers to implementing EIDM, and promoted the formation of long-lasting social connections among staff. Organization-wide presentations and meetings facilitated the recognition of expertise that the trained staff gained, including their reputation as experts according to their peers in different divisions. CONCLUSION: Selective training and capacity development interventions can result in forming an elite versus ordinary pattern that facilitates the recognition of in-house qualified experts while also strengthening social status inequality. The role of leadership in public health units is pivotal in championing and overseeing the implementation process. Network analysis can guide and inform the design, process, and evaluation of the EIDM training interventions

Dissemination and implementation science training needs: Insights from practitioners and researchers

INTRODUCTION: Dissemination and implementation research training has great potential to improve the impact and reach of health-related research; however, research training needs from the end user perspective are unknown. This paper identifies and prioritizes dissemination and implementation research training needs. METHODS: A diverse sample of researchers, practitioners, and policymakers was invited to participate in Concept Mapping in 2014–2015. Phase 1 (Brainstorming) gathered participants' responses to the prompt: To improve the impact of research evidence in practice and policy settings, a skill in which researchers need more training is… The resulting statement list was edited and included subsequent phases. Phase 2 (Sorting) asked participants to sort each statement into conceptual piles. In Phase 3 (Rating), participants rated the difficulty and importance of incorporating each statement into a training curriculum. A multidisciplinary team synthesized and interpreted the results in 2015–2016. RESULTS: During Brainstorming, 60 researchers and 60 practitioners/policymakers contributed 274 unique statements. Twenty-nine researchers and 16 practitioners completed sorting and rating. Nine concept clusters were identified: Communicating Research Findings, Improve Practice Partnerships, Make Research More Relevant, Strengthen Communication Skills, Develop Research Methods and Measures, Consider and Enhance Fit, Build Capacity for Research, and Understand Multilevel Context. Though researchers and practitioners had high agreement about importance (r =0.93) and difficulty (r =0.80), ratings differed for several clusters (e.g., Build Capacity for Research). CONCLUSIONS: Including researcher and practitioner perspectives in competency development for dissemination and implementation research identifies skills and capacities needed to conduct and communicate contextualized, meaningful, and relevant research

Developing educational competencies for dissemination and implementation research training programs: An exploratory analysis using card sorts

Abstract Background With demand increasing for dissemination and implementation (D&I) training programs in the USA and other countries, more structured, competency-based, and tested curricula are needed to guide training programs. There are many benefits to the use of competencies in practice-based education such as the establishment of rigorous standards as well as providing an additional metrics for development and growth. As the first aim of a D&I training grant, an exploratory study was conducted to establish a new set of D&I competencies to guide training in D&I research. Methods Based upon existing D&I training literature, the leadership team compiled an initial list of competencies. The research team then engaged 16 additional colleagues in the area of D&I science to provide suggestions to the initial list. The competency list was then additionally narrowed to 43 unique competencies following feedback elicited from these D&I researchers. Three hundred additional D&I researchers were then invited via email to complete a card sort in which the list of competencies were sorted into three categories of experience levels. Participants had previous first-hand experience with D&I or knowledge translation training programs in the past. Participants reported their self-identified D&I expertise level as well as the country in which their home institution is located. A mean score was calculated for each competency based on their experience level categorization. From these mean scores, beginner-, intermediate-, and advanced-level tertiles were created for the competencies. Results The card sort request achieved a 41 % response rate (n = 124). The list of 43 competencies was organized into four broad domains and sorted based on their experience level score. Eleven competencies were classified into the “Beginner” category, 27 into “Intermediate,” and 5 into “Advanced.” Conclusions Education and training developers can use this competency list to formalize future trainings in D&I research, create more evidence-informed curricula, and enable overall capacity building and accompanying metrics in the field of D&I training and research.http://deepblue.lib.umich.edu/bitstream/2027.42/113065/1/13012_2015_Article_304.pd

Training scholars in dissemination and implementation research for cancer prevention and control: A mentored approach

Abstract Background As the field of D&I (dissemination and implementation) science grows to meet the need for more effective and timely applications of research findings in routine practice, the demand for formalized training programs has increased concurrently. The Mentored Training for Dissemination and Implementation Research in Cancer (MT-DIRC) Program aims to build capacity in the cancer control D&I research workforce, especially among early career researchers. This paper outlines the various components of the program and reports results of systematic evaluations to ascertain its effectiveness. Methods Essential features of the program include selection of early career fellows or more experienced investigators with a focus relevant to cancer control transitioning to a D&I research focus, a 5-day intensive training institute, ongoing peer and senior mentoring, mentored planning and work on a D&I research proposal or project, limited pilot funding, and training and ongoing improvement activities for mentors. The core faculty and staff members of the MT-DIRC program gathered baseline and ongoing evaluation data regarding D&I skill acquisition and mentoring competency through participant surveys and analyzed it by iterative collective reflection. Results A majority (79%) of fellows are female, assistant professors (55%); 59% are in allied health disciplines, and 48% focus on cancer prevention research. Forty-three D&I research competencies were assessed; all improved from baseline to 6 and 18 months. These effects were apparent across beginner, intermediate, and advanced initial D&I competency levels and across the competency domains. Mentoring competency was rated very highly by the fellows––higher than rated by the mentors themselves. The importance of different mentoring activities, as rated by the fellows, was generally congruent with their satisfaction with the activities, with the exception of relatively greater satisfaction with the degree of emotional support and relatively lower satisfaction for skill building and opportunity initially. Conclusions These first years of MT-DIRC demonstrated the program’s ability to attract, engage, and improve fellows’ competencies and skills and implement a multicomponent mentoring program that was well received. This account of the program can serve as a basis for potential replication and evolution of this model in training future D&I science researchers

Enhancing evidence-based diabetes and chronic disease control among local health departments: A multi-phase dissemination study with a stepped-wedge cluster randomized trial component

Examples of Intervention Dissemination Strategies and Description. (DOCX 22 kb